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Abstract 

For a d-dimensional diffusion of the form dX t = fi(Xi)dt + a(X t )dWt, and continuous 
functions / and g, we study the existence and the uniqueness of adapted processes Y, 
Z, r and A solving the second order backward stochastic differential equation (2BSDE) 

dY t = f(t,x t ,Y t ,z t ,r t )dt + z^odX t , te[o,T), 

dZ t = A t dt + T t dX t , te [0, T) , 
Y T = g(X T ). 

If the associated PDE 

-v t (t,x) + f{t,x 1 v{t,x),Dv(t,x),D 2 v(t,x)) = 0, (i, x) G [0,T) x R d , 
= ff(af) , 

admits a C 3 -solution, it follows directly from Ito's lemma that the processes 

v{t,X t ), Dv(t,X t ), D 2 v(t,X t ), £Dv(t,X t ), te[0,T], 

solve the 2BSDE, where C is the Dynkin operator of X without the drift term. 

The main result of the paper shows that if the PDE has comparison as in the theory 
of viscosity solutions and if / is Lipschitz in Y and decreasing in T, the existence of 
a solution (Y, Z, T, A) to the 2BSDE implies that the associated PDE has a unique 
continuous viscosity solution v, and Y t = v(t,X t ), t £ [0,T]. In particular, the 2BSDE 
has at most one solution. This provides a stochastic representation for solutions of fully 
non-linear parabolic PDEs. As a consequence, the numerical treatment of such PDE's 
can now be approached by Monte Carlo methods. 
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1 Introduction 



Since their introduction, backward stochastic differential equations (BSDEs) have received 
considerable attention in the probability literature. Interesting connections to partial dif- 
ferential equations (PDEs) have been obtained and the theory has found wide applications 
in areas like stochastic control, theoretical economics and mathematical finance. 

BSDEs were introduced by Bismut (1973) for the linear case and by Pardoux and Peng 
(1990) for the general case. According to these authors, a solution to a BSDE consists of a 
pair of adapted processes (Y, Z) taking values in 1" and M rfxn , respectively, such that 

dY t = f(t, Y tt Z t )dt + Z' t dW t , t € [0, T) , 
Yt = Z, 

where T is a finite time horizon, (Wt)t£[o,T] a d-dimensional Brownian motion on a filtered 
probability space ($7, J 7 , (•7 r t)te[o,T]> / a progressively measurable function from x 
[0, T] x R n x R dxn to W n and £ an R n -valued, .F^-measurable random variable. 

The key feature of BSDEs is the random terminal condition £ that the solution is required 
to satisfy. Due to the adaptedness requirement on the processes Y and Z, this condition 
poses certain difficulties in the stochastic setting. But these difficulties have been overcome, 
and now an impressive theory is available; see for instance, Bismut (1973, 1978), Arkin and 
Saksonov (1979), Pardoux and Peng (1990, 1992, 1994), Peng (1990, 1991, 1992a, 1992b, 
1992c, 1993), Antonelli (1993), Ma, et al. (1994, 1999, 2002), Douglas et al. (1996), Cvitanic 
and Ma (1996), Cvitanic and Karatzas (1996), Chevance (1997), Cvitanic et al. (1999), 
Pardoux and Tang (1999), Delarue (2002), Bouchard and Touzi (2004), or the overview 
paper El Karoui et al. (1997). 

If the randomness in the parameters / and £ in (|1.1|) is coming from the state of a 
forward SDE, then the BSDE is referred to as a forward-backward stochastic differential 
equation (FBSDE) and its solution can be written as a deterministic function of time 
and the state process. Under suitable regularity assumptions, this function can be shown 
to be the solution of a parabolic PDE. FBSDEs are called uncoupled if the solution to 
the BSDE does not enter the dynamics of the forward SDE and coupled if it does. The 
corresponding parabolic PDE is semi-linear in case the FBSDE is uncoupled and quasi- 
linear if the FBSDE is coupled; see Peng (1991, 1992b), Pardoux and Peng (1992), Antonelli 
(1993), Ma et al. (1994), Pardoux and Tang (1999), Ma and Yong (1999). These connections 
between FBSDEs and PDEs have led to interesting stochastic representation results for 
solutions of semi-linear and quasi-linear parabolic PDEs, generalizing the Feynman-Kac 
representation of linear parabolic PDEs and opening the way to Monte Carlo methods for 
the numerical treatment of such PDEs, see for instance, Zhang (2001), Bally and Pages 
(2002), Ma et al (1994, 1999, 2002), Bouchard and Touzi (2004), Delarue and Menozzi 
(2004). However, PDEs corresponding to standard FBSDEs cannot be non-linear in the 
second order derivatives because the second order terms only arise linearly through Ito's 
formula from the quadratic variation of the underlying state process. 

In this paper we introduce FBSDEs with second order dependence in the generator /. We 
call them second order backward stochastic differential equations (2BSDEs) and show how 
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they are related to fully non-linear parabolic PDEs. This extends the range of connections 
between stochastic equations and PDEs. In particular, it opens the way for the development 
of Monte Carlo methods for the numerical solution of fully non-linear parabolic PDEs. Our 
approach is motivated by results in Cheridito et al. (2005a, 2005b) which show how second 
order trading constraints lead to non-linear parabolic Hamilton-Jacobi-Bellman equations 
for the super-replication cost of European contingent claims. 

The structure of the paper is as follows: In Section |2J we explain the notation and 
introduce 2BSDEs together with their associated PDEs. In Section |3J we show that the 
existence of a C 3 solution to the associated PDE implies the existence of a solution to the 
2BSDE. Our main result in Section 0] shows the converse: If the PDE satisfies comparison as 
in the theory of viscosity solutions and suitable Lipschitz and monotonicity (parabolicity) 
conditions, then the existence of a solution to the 2BSDE implies that the PDE has a 
unique continuous viscosity solution v. Moreover, the solution of the 2BSDE can then be 
written in terms of v and the underlying state process. This implies that the solution of 
the 2BSDE is unique, and it provides a stochastic representation result for fully non-linear 
parabolic PDEs. In Section [5] we discuss Monte Carlo schemes for the numerical solution 
of such PDEs. In Section 6 we shortly discuss how the results of the paper can be adjusted 
to the case of PDEs with boundary conditions. 

Acknowledgements. Parts of this paper were completed during a visit of Soner and 
Touzi to the Department of Operations Research and Financial Engineering at Princeton 
University. They would like to thank Princeton University, Erhan Qinlar and Patrick 
Cheridito for the hospitality. We also thank Shige Peng and Arturo Kohatsu-Higa for 
stimulating and helpful discussions. 

2 Notation and definitions 

Let d > 1 be a natural number. We denote by M d the set of all d x d matrices with 
real components. B' is the transpose of a matrix B G A4 d and Tr[5] its trace. By Aif nY 
we denote the set of all invertible matrices in M d , by S d all symmetric matrices in M d , 
and by Si all positive semi-definite matrices in Ai d . For B,C G Ai d , we write B > C if 
B -C e5f. For x G R d , we set 

\x\ := ^x\ + ...x 2 d 

and for B G M d , 

\B\ := sup Bx . 

x£R d ,\x\<l 

Equalities and inequalities between random variables are always understood in the almost 
sure sense. We fix a finite time horizon T G (0,oo) and let (Wt)t£[o,T] De a d-dimensional 
Brownian motion on a complete probability space (£1,J-,P). For t G [0, T], we set := 
W s — Wt, s G [t,T] and denote by ¥ t,T = (J-^s^t^] the smallest filtration satisfying the 
usual conditions and containing the filtration generated by (Wl) a e[t,T\- 
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The coefficients /i : R d — > R d and a : R d — > -M-l are continuous functions, such that for 
all N >0, there exists a constant Ljy with 

|/x(a;) - ^(y)| + \a(x) - a{y)\ < L N \x - y\ for all x,y £R d with \x\ ,\y\ < N ,(2.1) 

and constants L > and pi E [0, 1] such that 

\n(x)\ + \a(x)\ <L(l + |x| Pl ) for all x e R d . (2.2) 

Then, for every initial condition (t, x) 6 [0, T] x R rf , the forward SDE 

dX s = fi{X s )ds + a(X s )dW s , s G [t, T] , 
At = X, 

has a unique strong solution (Xl' x ) se u T i. This follows for instance, from Theorems 2.3, 
2.4 and 3.1 in Chapter IV of Ikeda and Watanabe (1989). Note that for existence and 
uniqueness of a strong solution to the SDE (|2.3j) . p\ = 1 in condition (|2.2j) is enough. But 
for pi £ [0, 1), we will get a better growth exponent p in Proposition 14.51 below. In any 
case, the process (Xl' x ) s ^ t ^ is adapted to the filtration ¥ t,T , and by Ito's formula we have 
for all s £ [t,T] and cp £ C l > 2 ([t,T] x R d ), 

</>(s,A^) = p(t,2;)+ [ C<p(r,X t r > x )dr + [* Dtp (r, X^)' dX^ , (2.4) 

where 

£<p(t, x) = cp t (t, x) + ^Tr[D 2 ip(t, x)a{x)a(x)'] , 

and Dip, D 2 tp are the gradient and the matrix of second derivatives of ip with respect to 
the x variables. 

In the whole paper, / : [0, T) x R d x R x R d x S d -> R and 5 : R ' -> R are continuous 
functions. 

Definition 2.1 Zei (t,x) G [0,T) x R d and (Y s , Z s , F s , A s ) s£[t)T] a quadruple of F*' T - 
progressively measurable processes taking values in R, R d , S d and R d , respectively. Then 
we call (Y, Z,T,A) a solution to the second order backward stochastic differential equation 
(2BSDE) corresponding to (X t,x , f, g) if 

dY s = f(s,X t s > x ,Y s ,Z s ,T s )ds + Z' s odX t s > x , se[t,T), (2.5) 
dZ s = A s ds + T s dXl' x , se[t,T), (2.6) 
Y T = g (X^) , (2.7) 

where Z' s o dX s ' x denotes Fisk-Stratonovich integration, which is related to ltd integration 
by 

Z> o dX? = Z' s dX*f + ~d(Z, X^) s = Z> dX? + ~ Tr[r s a(X*>>(X<-*)'] ds . 
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The equations (|2.5|) - (|2.7[l can be viewed as a whole family of 2BSDEs indexed by (t, x) E 
[0, T) E R d . In the following sections, we will show relations between this family of 2BSDEs 
and the associated PDE 

-v t (t,x) + f (t,x,v{t,x),Dv{t,x),D 2 v(t,x)) = on [0, T) x R d , (2.8) 

with terminal condition 

v(T,x) = g(x), xeR. (2.9) 

Since Z is a semi-martingale, the use of the Fisk-Stratonovich integral in Q2.5|) means no 
loss of generality, but it simplifies the notation in the PDE (|2.8j) . Alternatively, 1)2. 5 j) could 
be written in terms of the Ito integral as 

dY s = f(s,X t s > x ,Y s ,Z s ,T s )ds + Z' s dX t s > x (2.10) 

for 

f(t,x,y,z,j) = f(t,x,y,z,~f) + ^ Tr [ya(x)a(x)'] . 
In terms of /, the PDE (|2.8|) reads as follows: 

-v t (t, x) + f(t, x, v(t, x),Dv(t, x),D 2 v(t, x)) - ^Tr[D 2 v(t, x)a(x)a(x)'} = . 

Note that the form of the PDE (|2.8j) does not depend on the functions fi and a determining 
the dynamics in (J2.cSI) . So, we could restrict our attention to the case where [i = and 
a = Id, the d x d identity matrix. But the freedom to choose \x and a from a more general 
class provides additional flexibility in the design of the Monte Carlo schemes discussed in 
Section |S] below. 

3 From a solution of the PDE to a solution of the 2BSDE 

Assume v : [0, T] x M. d — > R is a continuous function such that 

Vt, Dv, D 2 v, CDv exist and are continuous on [0, T) x M. d , 

and v solves the PDE ()2.8|) with terminal condition (J2.9|) . Then it follows directly from 
Ito's formula ()2.4I) that for each pair (t, x) E [0, T) x R d , the processes 

Y s = v{ 8 ,X%°) , se[t,T], 

Z s = Dv(s,Xl> x ) , se[t,T], 

T s = D 2 v{s,X t > x ) , se[t,T], 

A s = CDv(s,Xl' x ) , se[t,T], 

solve the 2BSDE corresponding to (X t,x ,f,g). 
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4 From a solution of the 2BSDE to a solution of the PDE 

In all of Section 0] we assume that 

/:[0,T)xl li xlxK' i x5 tl ^R and g : R d -» R 

are continuous functions that satisfy the following Lipschitz and growth assumptions: 
(Al) For every N > 1 there exists a constant Fn such that 

\f(t,x,y,z,i) - f(t,x,y,z,j)\ < F N \y-y\ 

for all (t,x,y,y,z,j) G [0,T] x R d x R 2 x R d x S d with max{|x| , \y\ , \y\ , \z\ , |-y | } < N. 
(A2) There exist constants F and p2 > such that 

x, y, z, 7 )| < F(l + |xp + + |zp + | 7 | P2 ) 

for all (t, x, y, z, 7) £[0,T]xl d xlxM* i x S d . 
(A3) There exist constants G and p% > such that 

|s(x)| < G(l + |xH for all x G R rf . 
4.1 Admissible strategies 

We fix constants P4,ps > and denote for all (t,x) G [0,T] x R d and m > by ./l^f the 
class of all processes of the form 



ps rS 

Z s = z+ I A r dr + I V r dXl' x , s G [t, T] , 
Jt Jt 



where z G R d , (A s ) se \ ti x] is an Revalued, F* ,T -progressively measurable process, (r s ) sg [ t T 1 ] 
is an 5 d -valued, F*' T -progressively measurable process such that 

max{|Z s | , \A S \ , \T S \} < m(l + \Xl' x \ P4 ) for all s G [t, T] , (4.1) 

and 

|r r - T s | < m(l + \X^ X \P 5 + |X*' x |P 5 )(|r -s\ + \Xl> x - X l f\) for all r, s G [i, T] . (4.2) 

Set _4* ,:c := U m >o^™ • ^ f° nows from the assumptions (Al) and (A2) on / and condition 
(jHU on Z that~for all y G R and Z G A^ x , the forward SDE 

dY s = /(^X^n.^.r^cfa + ^oAX^*, sG[t,T], (4.3) 
Y t = y, (4.4) 

has a unique strong solution ( Yg' x,v,Z ) (this can, for instance, be shown with the 

V / se[t,T] 

arguments in the proofs of Theorems 2.3, 2.4 and 3.1 in Chapter IV of Ikeda and Watanabe, 
1989). 
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4.2 Auxiliary stochastic target problems 

For every m > 0, we define the functions V m , U m : [0, T] x M. d —> R as follows: 
V m (t, x) := inf{y G R : y*'**" 2 > <?(X^f) for some Z G ^} , 

and 

I7 m (t, z) := sup{y G M : Y^ ,x,y,z < g(X^ x ) for some Z G .4^?} . 

Notice that these problems do not fit into the class of stochastic target problems studied 
by Soner and Touzi (2002) and are more in the spirit of Cheridito et al. (2005a, b). 

Lemma 4.1 (Partial Dynamic Programming Principle) 

Let (t,x,m) G [0,T) xR d xl + and (y, Z) G R x jt£ such that Y^ x ' y ' Z > g(X^ x ). Then 

Y t,x,y,z > ym^ x t,x^ j Qr aU s G ^ T ) _ 

Proof. Fix s G (i, T) and denote by C d [t, s] the set of all continuous functions from [t, s] to 
R d . Since X S M and y£' x ' v ' z are jF*-measurable, there exist measurable functions 

£ : C d [i, s] -► R d and V : C d [t, a] -»• R 

such that 

Xl' x = ^(W l ' s ) and Y*' x ' y > z = ^(W l ' s ) , 
where we denote W t,s := (W*) r e[t,s]- The process Z is of the form 

Z r = z+ A u du+ T u dX^ x , re[t,T], 
Jt Jt 

for z G R, (-Ar)re[t,T] an Revalued, F' ,T -progressively measurable process, and (T r ) r e[t,T] 
an <S d -valued, F* ,T -progressively measurable process. Therefore, there exist progressively 
measurable functions (see Definition 3.5.15 in Karatzas and Shreve, 1991) 

(A : [t,T]xC d [t,T]^R d 
X : [t,T] xC d [t,T]^S d 

such that 

Z r = C(r, W l ' T ) , A r = (j)(r, W 1 ' 7 ) and T r = X {r,W t ' T ) for re[t,T], 

where W t,T := (W*) r e[t,T|- With obvious notation, we define for every w G C d [t, s] the 
Revalued, F s ' T -progressively measurable process [Z™) r e[s,T] by 

rr rr 

Z? = C(s,w)+ <p(u,w + W s ' T )du+ X {u,w + W s ' T )du, re[s,T}. 

J s J s 
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Let (i be the distribution of W f > s on C d [t,s]. Then, Z w G Af£ {w) for ^-almost all w G 
C d [t,s], and 



Y t,x,y,Z > 



P 



Yr, 



> g{X s / iw) ) | W f ' s = w dfi(w) 



r 



Hence, for ^-almost all w G C d [t,s], the control Z w satisfies 



P 



which shows that ^(w) = Ys s ' aw)Mw) ' ZW > v™(s, £(«;)). In view of the definition of the 
functions f and V, this implies that Y*' x ' y ' Z > V m {s, X^ x ). □ 

Since we have no a priori knowledge of any regularity of the functions V m and U m , we 
introduce the semi-continuous envelopes as in Barles and Perthame (1988) 

V™{t,x) := Jim inf V m (t,x) and U* t {t,x) := limsup U m (i,x), 
(i,x)->{t,x) " (t,x)-»(t,s) 

for all (i,x) G [0, T] x E d , where we set by convention V m (i,x) = —U m (t,x) = oo for 
t ^ [0, T]. For the theory of viscosity solutions, we refer to Crandal et al. (1992) and the 
book of Fleming and Soner (1993). 

Theorem 4.2 Let m > 0, and assume that V™ is R-valued. Then V™ is a viscosity 
supersolution of the PDE 

-v t (t,x) + sup / (t,x,v{t,x),Dv{t,x),D 2 v(t,x) + 0) = on [0, T) x R d . 

Pes* 

Before turning to the proof of this result, let us state the corresponding claim for the 
value function U m . 

Corollary 4.3 Let m > 0, and assume that is R-valued. Then is a viscosity 
subsolution of the PDE 

-u t (t,x) + inf / (t,x,u(t,x),Du{t,x),D 2 u(t,x) - 0) = on [0, T) x R d .(4.5) 

Proof. Observe that for all (t, x) G [0, T) x R d , 

-U m (t, x) = inf \y G R : Y^ Z > -g{x!f) for some Z G } , 
where for given (i/,Z) ElxA 1 , the process 

yt,x,j/,z ig the 

unique strong solution of the 

SDE 

Y » = V + f -/fr " r -) dr + jf ^ ° ^ ' s G t^ T ] • 
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Hence, it follows from Theorem 14.21 that — = (—U m )* is a viscosity supersolution of the 
PDE 

-u t (t,x) - inf f (t,x,-u(t,x),-Du(t,x),-D 2 u{t,x) - (3) = on[0,T)xIR d , 



which shows that is a viscosity subsolution of the PDE (|4.5|) on [0, T) 



□ 



Proof of Theorem gH] Choose (t ,x ) G [0,T) x R d and ip G C°°([0,T) x R d ) such that 
O=(K m -¥0(*o,*o) = min (V™- V )(t,x). 

(t,x)e[0,T)xl d 

Let (t n ,x n ) — » (to,^o) such that V rm (t n ,x n ) — » VJ" , (io ! ^o)- There exist positive numbers 
e n — > such that for y n = V m {t n , x n ) + e n , there exists Z n G Am' Xn with 

Y$ > g(X£), 

where we denote (X n ,Y n ) = (X*™^™, Y*"' 2 ^™^") an d 

^ s n = z n + f Ay r + f ryx?, se[t n ,T}. 

Jin ^ in 

Note that for all n, is almost surely constant, and \z n \, |r™ | < m(l + |x n | P4 ) by as- 
sumption (|4.1j) . Hence, by passing to a subsequence, we can assume that z n — > zq G M rf and 
— > 70 G S d . Observe that a n := y n — ip(t n ,x n ) — > 0. We choose a decreasing sequence 
of numbers 5 n G (0, T — t n ) such that 5 n —* and ct n /5 n — > 0. By Lemma 14. II 

and therefore, 

y t"+5 n - ^ + Q» > (tn + S n , X? n+8n ) - ip(t n ,X n ) , 

which, after two applications of Ito's Lemma, becomes 



Qn + 



[f(s, X?, Y s n , z?, r?) - Ms, X?)]ds 



+ [z n - D(p(t n ,x n )] [X? n+Sn - x n ] 

+ ( A™ - CDip(r, X™)dr J o dX™ 

ftn+Sn / PS \ / 

+ / f / rp-£>V(r,^)dX?) odX s n > 
It is shown in Lemma 14.41 below that the sequence of random vectors 

^ C ItT 5 " {SI T r ~ DMr,X?)dX?)' o dX? 



(4.6) 



(4.7) 
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converges in distribution to 



/ f(to,xo,cp(tQ,xo),zo,jo) - <pt(t Q ,xa) \ 
<j{x G )Wi 


\ ±W{a(xo)'ho-D 2 <p{t ,x )]a(x )Wi J 



(4- 



1/2 

Set Vn — \z n ~ D(p(t n , x n )\, and assume S n r\ n — > oo along a subsequence. Then, along 
another subsequence, ry~ 1 (z n — Dip(t n , x n )) converges to some 770 £ M d with 

M = l. (4.9) 

Multiplying inequality (|4.6|) with 5 n 1 r/~ l and passing to the limit yields 

v' a{x )W 1 > , 

1/2 

which, since a(xo) is invertible, contradicts (|4.9|) . Hence, the sequence (5 n rj n ) has to be 
bounded, and therefore, possibly after passing to a subsequence, 

&n 1 [ z n — Dip(t n ,x n )] converges to some £0 G ^ d • 

It follows that zq = Dip(tQ, xq). Moreover, we can divide inequality (|4.6|) by 5 n and pass to 
the limit to get 

/(t , Xq, lf(t , X ), Dlf(t , X ), 70) - ip t (t , Xq) 

1 (4.10) 
+ i , Qa{ X Q)W l + -W[a(x )'[ l0 - D\(t ,x ))a(x )W 1 > . 

Since the support of the random vector W\ is it follows from (|4. 1U|) that 

f(to,x ,(p(to,x ),D(p(t ,x ),"fo) - ip t (t ,x ) 
+ ^(x )w + -u>V(x )'[7o - D 2 ip(t , x )]a(x )w > , 

for all w (zM. d . This shows that 

f(t , x Q , <p(t , x ),Dp(t , xq), 70) - ipt(t ,x ) > and /3 := 70 - D 2 ip(t , x ) > , 
and hence, 

-<p t (t ,x ) + sup /(i ,zo,^(*o,zo),^(*o,zo),#V(*o,zo) + /?) > 0. 

□ 



Lemma 4.4 T/ie sequence of random vectors (j4.7j) converges in distribution to (f4.8f) . 
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Proof. With the methods used to solve Problem 5.3.15 in Karatzas and Shreve (1991) it 
can also be shown that for all fixed q > and m > 0, there exists a constant C > such 
that for all < t < s < T, x G R d , y G M and Z G .4? 



E 



max 
Lse[t,T] 



E 
E 



<-t,x 



r£[t,s] 



max ly*'**^ 

s6[t,T] 



E 



max \Y*' x ' y ' Z - y\ 
re[M] 



< C(l + \x\ q ) 

< C{l + \x\ q )(s-t) q / 2 

< C{l + \y\ q + \x\ q ) 

< C(l + \y\ q + \x\ q )(s-t) q ' 2 . 



(4.11) 
(4.12) 
(4.13) 
(4.14) 



where q : = max {p2q , P2P4Q , (P4 + 2pi)g}. For every n > 1, we introduce the F*"' T - 
stopping time 

r n := inf{s > t n : X™ <£ B x {x )} A (t n + <5 n ) , 

where Bi(xo) denotes the open unit ball in R rf around xq. It follows from the fact that 
x n — ► xo and (|4.12|) that 

P[r n < i n + 5 n ] . (4.15) 



The difference 
can be written as 



{Xl +Sn - x n ) - a(x )(W tn+Sn - W tn ) 



and obviously, 



1 



[*(X?) - a{x n )]dW s + (a(x n ) - a(x ))(W tn+Sn - W tn ] 



:(a(x n ) - a(x ))(W tn+5n - W tn ) - in L 2 



VS r . 

Moreover, it can be deduced with standard arguments from IJ2.1JI . (|2.2j) . (|4.11|) and (|4.12j) 

that 



1 



This shows that 
1 



n{X™)ds -> and -= 



Jn Jt 



[cr(X s n ) - a(x n )]dW s -► in L 2 . 



{ X t n +S„ ~ x n~ o-(x )(W tn+ 5 n - W*J} -► in probability. 



Similarly, it can be derived from the boundedness assumption (|4.1j) on A n that 



A n T - CD^(r, X?) drj o dX™ -» in probability. 
By the continuity assumption (|4.2|) on r n , 

- / [r?-r?jdx r M odx?-o inL 2 , 



(4.16) 



(4.17) 
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and 



1 

5„ 



n 



-7;(Wt n +6 n ~ W t Ja(x y l0 a(x )(W tn+Sn - W K 



in probability. 



Hence, 



1 



J n {Jt 



tn+S 



1 1 '« y 



dXl 



(4.18) 



in probability. 



Similarly, it can be shown that 



(4.19) 



1 f ftn+Sn f fS \> 

- / / Z?V(r,^)dXM odX s « 

-^(W*„ +5n - Ty t JV(x ) / J DV(io^o)^(2;o)(^ Tn - WiJ j - in probability. 

Finally, it follows from the continuity of / and tp t as well as fj4. 1|) , (j4.2j) , (|4.11|) , (|4.12|) and 
(I4~TH that 



<5n Jt 



[/(X™, y™, Z s ", T n s ) - pt(s, X?)} ds - /(x , £>¥>(t , xo), *b, 7o) - ^(to, ^o) (4-20) 



in probability. Now, the lemma follows from (|4.16|) - (|4.2U|) and the simple fact that for each 
n, the random vector 



/ 



\ 



f(x ,f(to,xo),z ,jo) - <Pt(to,x ) 
5n 1/2 a(x )(W tn+5n -W tn ) 


\ S-m\V tn+Sn - WtJaixoYfro-DMtoixtiMxoXWi,,^ - U ,, ) ) 

has the same distribution as 

/ /(a7o>v(*o>»o),^o>7o) - <M*o,«o) \ 
ff(a;o)Wi 


\ i^(7(xo)'[7o-£)V(io,Xo)]^(xo)Wi / 



□ 



We conclude this subsection by the following bounds on the growth of the value functions 
V m and U m . 

Proposition 4.5 Letp = max{p2 > P3 > P2P4 , P4 + 2pi}. TTien there exists for every m > 
a constant C m > such that 



Vr(t,x) > -C m (l + |x| p ) and 
U^(t,x) < C m (l + \x\ p ) 



(4.21) 
(4.22) 
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for all (t,x) e [0,T] x R d . Moreover, 



V™(T,x) > g(x) and 
t/*(T,x) < g(x) 



(4.23) 
(4.24) 



for all 



Proof. We show <|4T22|t and (jHHJ. The proofs of (jOJ) and l)Q5|) are completely analogous. 
To prove (|4.22|) it is enough to show that for fixed m > 0, there exists a constant C m > 
such that for all (t,x) G [0,3] x M d and (y, Z) eRx satisfying Y^ x ' y ' Z < g{X^ x ), we 
have 

y < C m (l + \x\P). 

For y < there is nothing to show. So, we assume y > and introduce the stopping time 

t ■=\n{{s>t\Y t s > x > y > z = 0} f\T . 
Then, we have for all s £ [t,T], 

/sVr i>s\/t 
f(r,X t / x ,Y r t ' X ' y ' Z ,Z r ,T r )dr+ / Z' r ^X^)dr 
J S 

/sVt -i ps\Zr 

Z' r a{X^ x )dW r + -J TrlrXX^MX^)']* 

f(r, X?, Y*' x ' v ' z , Z r ,T r )dr + / Z' r o dX*-* 

r 

< S (^)V0. 

Hence, it follows from (A2), (A3), (|2.2|l and (|4.1I) that for p = max{p2 , P2Pa , Pi + 2pi}, 
:= E [l^** 

r csVt 

|/(r,x^,y r ^ z ,z r ,r r )|dr 



< E 
+E 

< GE 



t,X\ 

T i 



9(Xt 

r rsVr 



+ E 



/sVt "I n /-sVt 

jZ^X^)!^ +E -/ |Tt|T r <r(^' x )(T(^ !B ) , ]|dr 
J is 



1 + |A^Y 3 



+ F / h(r)dr + K [ (1 + \X l r < x \v)dr 



< K(l + \x\ p ) + F \ h(r)dr 



for constants K and K independent of t, x, y and Z. It follows from Gronwall's lemma 
that 

h{s) < K(l + \x\ p )e F(T - s) for all s G [t, T] . 
In particular, y = h(t) < C m (l + |x| p ) for some constant C m independent of t, x, y and Z. 



13 



To prove (|4.24|) . we assume by way of contradiction that there exists an a; £ R d such 
that C/^(T, x) > g(x) + 3e for some e > 0. Then, there exists a sequence (t n ,x n ) n >i in 
[0, T) x R d converging to (T, x) such that U m (t n ,x n ) > g(x) + 2e for all n > 1. Hence, for 
every integer n > 1, there exists a real number y n £ [<?(x) + £, <?(x) + 2s] and a process 

Z n g of the form = Zn + J£ + j£ r^dXs™'*™ Such that 

Vn < 9(X^' Xn ) - / f(s, Xl n,Xn , Y*> Xn > Vn > zn : Z™, T™)ds - / (Z™)' o dX^ x " . (4.25) 

By (|4.1|) . (|4.11|) . 1)4.121) and (|4.13|) . the right-hand side of (|4.25|1 converges to g{x) in proba- 
bility. Therefore, it follows from (|4.25|) that g{x) +e < g(x). But this is absurd, and hence, 
we must have U^(T,x) < g(x) for all x £ R d . □ 



4.3 Main result 

For our main result, Theorem 14.91 below, we need two more assumptions on the functions 
/ and g, the first of which is 
(A4) For all (t, x, y, z) £ [0, T) x R d x R x R d and 7, 7 £ 5 d , 

f(t,x,y,z,i) > f(t,x,y,z,^) whenever 7 < 7. 

Remark 4.6 Under (Al)-(A4) it immediately follows from Theorem 14. 21 that V™ is a vis- 
cosity supersolution of the PDE 1)2.8)1 on [0, T) x R d , provided it is R-valued. Analogously, if 
(Al)-(A4) hold and is R-valued, Corollary 14 . 31 implies that is a viscosity subsolution 
of the PDE (|23J on [0, T) x R d . 

For our last assumption and the statement of Theorem 14.91 we need the following 

Definition 4.7 Let q>0. 

1. We call a function v : [0, T] x R d — > R a viscosity solution with growth q of the PDE 
(|2.8j) w't/i terminal condition 1)2.9)1 if v is a viscosity solution of 1)2.8)1 on [0, T) x R rf smc/i 
t/iat u*(T, x) = v*(T,x) = g{x) for all x £ R rf and i/iere exists a constant C such that 
\v(t,x)\ < C(l + |x| 9 ) /or a// (i,x) £ [0,T] x R d . 

2. VFe say i/iai the PDE ()2.8|) terminal condition 1)2.9)1 comparison with growth q 
if the following holds: 

If w : [0, T] x R d — > R is lower semicontinuous and a viscosity supersolution of 1)2.8)1 on 
[0, T) x R d and n : [0, T] x R d — » R upper semicontinuous and a viscosity subsolution of 
(J2~8l) on [0, T) x R d sw/i that 

w(T, x) > g(x) > u(T, x) for all x £ R d 

and there exists a constant C > with 

w(t,x) > -C(l + |x| p ) and u(t, x) < C(l + |x| p ) /or a// (i, x) £ [0, T) x R d , 

£/ien w>u on [0, T] x R d . 
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With this definition our last assumption on / and g is 

(A5) The PDE (|2.8j) with terminal condition 1)2.9)1 has comparison with growth p = 
max {p 2 , P3 , P2PA , P4 + 2pi}. 

Remarks 4.8 

1. The monotonicity assumption (A4) is natural from the PDE viewpoint. It implies that 
/ is elliptic and the PDE ()2.8|) parabolic. If / satisfies the following stronger version of 
(A4): there exists a constant C > such that 

f(t, x, y,z,y-B)> f(t, x, y, z,-y)+C Tr[B) (4.26) 

for all (t, x, y, z, 7) G [0, T) x R d x R x M. d x S d and B G S d , then the PDE (JTHJ) is called 
uniformly parabolic, and there exist general results on existence, uniqueness and smooth- 
ness of solutions, see for instance Krylov (1987) or Evans (1998). When / is linear in the 
7 variable (in particular, for the semi- and quasi- linear equations discussed in Subsections 
15.21 and 15.31 below), the condition Q4.26JI essentially guarantees existence, uniqueness and 
smoothness of solutions to the PDE 1)2.8(1 - 1)2.91) ; see for instance, Section 5.4 in Ladyzen- 
skaya et al. (1967). Without parabolicity there are no comparison results for PDEs of the 
form E2fr- gTfr . 

2. Condition (A5) is an implicit assumption on the functions / and g. But we find it 
more convenient to assume comparison directly in the form (A5) instead of putting tech- 
nical assumptions on / and g which guarantee that the PDE (J2.8|) with terminal condition 
(|2.9|) has comparison. Several comparison results for non-linear PDEs are available in the 
literature; see for example, Crandall et al. (1992), Fleming and Soner (1993), Cabre and 
Caffarelli (1995). However, most results are stated for equations in bounded domains. For 
equations in the whole space, the critical issue is the interplay between the growth of solu- 
tions at infinity and the growth of the non-linearity. We list some typical situations where 
comparison holds: 

a) Comparison with growth 1: Assume (A1)-(A4) and there exists a function h : [0, 00] — * 
[0, 00] with lim^^o h(x) = such that 

|/(f, x, y, a(x — x), A) — f(t, x, y, a(x — x), B)\ < h(a\x — x\ 2 + \x — x\), 

for all (t,x,x,y), a > and A, B satisfying 



—a 



I 







' A 







I 


-I 






< 






< a 









I 







—B 




-I 


I 



Then it follows from Theorem 8.2 in Crandall et al. (1992) that equations of the form (|2.8|) . 
([2.9)1 have comparison with growth if the domain is bounded. If the domain is unbounded, 
it follows from the modifications outlined in Section 5.D of Crandall et al. (1992) that 1)2.8)1 
and 1)2.9)1 have comparison with growth 1. 

b) When the equation 1)2.8)1 is a dynamic programming equation related to a stochastic 
optimal control problem, then a comparison theorem for bounded solutions is given in 
Fleming and Soner (1993), Section 5.9, Theorem V.9.1. In this case, / has the form 

f(t,x,y, z, 7) = sup {a(t,x,u) + (3(t,x,u)y + b(t, x,u)'z - Tr[c(t,x,u)j]} , 
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see Subsection 15.51 below. Theorem V.9.1 in Fleming and Soner (1993) is proved under the 
assumption that (3 = 0, U is a compact set and that a, b, c are uniformly Lipschitz and 
growing at most linearly (see IV (2.1) in Fleming and Soner, 1993). This result can be 
extended directly to the case where (3 satisfies a similar condition and to equations related 
to differential games, that is, when 

f(t, x, y, z, 7) = sup inf {a(t, x, u, u) + f3(t, x, u, u)y + b(t, x, u, u)'z — Tr[c(i, x, u, u)^/]} ■ 
ueUueu 

c) Many techniques in dealing with unbounded solutions were developed by Ishii (1984) 
for first order equations (that is, when / is independent of 7). These techniques can be 
extended to second order equations. Some related results can be found in Barles et al. 
(1997, 2003). In Barles et al (1997), in addition to comparison results for PDEs, one can 
also find BSDEs based on jump Markov processes. 

Theorem 4.9 (Uniqueness of 2BSDE) Assume (Al)-(A5) and there exists an xq G R d 
such that the 2BSDE corresponding to (X°' x °J,g) has a solution (Y°> xo , Z°> x °, T°' x °, A°> x °) 
with Z°> xo G A°' x ° . Then the following hold: 

1. The associated PDE (|2.8|) with terminal condition (|2.9|) has a unique viscosity solution 
v with growth p = max {p2 , P3 , P2P4 , Pi + 2pi}, and v is continuous on [0, T] x R rf . 

2. For all (t,x) £ [0,T) x W 1 , there exists exactly one solution (Y tjX , Z*^, T t,x , A^ x ) to the 
2BSDE corresponding to (X l ' x , f, g) such that Z t,x G A t,x , and the process Y t,x satisfies 

Y*> x = v{s,X?), se[t,T], (4.27) 

where v is the unique continuous viscosity solution with growth p of (|2.8I) - (|2.9|) . 

Before turning to the proof of this result, we make some remarks. 

Remark 4.10 If the assumptions of Theorem 14.91 are fulfilled, it follows from (|4.27|) that 
v(t,x) = Yf' x for all (t,x) £ [0,T) x Hence, v(t,x) can be approximated by backward 
simulation of the process (Y^^g^T]. If v is C 2 , it follows from Ito's lemma that Z^' x = 
Dv(s,X} x ), s £ [t,T\. Then, Dv(t, x) can be approximated by backward simulation of 
{Z t s ' x ) s£ ^ t T Y If v is C 3 , then also rl ,x = D 2 v(s, xt ,x ), s G [t,T], and D 2 v(t,x) can be 
approximated by backward simulation of (T s ' x ) s& [t : T}- A formal discussion of a potential 
numerical scheme for the backward simulation of the processes Y t,x , Z t,x and r t,x is provided 
in Subsection 15.41 below. 

Remark 4.11 Assume there exists a classical solution v of the PDE (|2.8|) such that 

Vt, Dv, D 2 v, CDv exist and are continuous on [0,T] x M. d , 
and there exists a constant m > such that 
\Dv(t,x)\ ] 

\D 2 v(t,x)\ \<m(l + \x\ P4 ) for all < t < T and x G R d . (4.28) 
\CDv(t,x)\ J 
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and 

\D 2 v{t, x) - D 2 v(s, y)\ < m(l + \x\ P5 + \y\ Ps ){\t -s\ + \x-y\) (4.29) 

for all < t, s < T and x, y G R d . 

Note that Q4.29JI follows, for instance, if ^D 2 v and D s v exist and 

maxij \w(& v & x )h\ 1 < ^(1 + \ X \P*) for all < t < T and x G R d . 
maxjj \D(D v (t, x))ij\ d 

Fix (t,x) G [0,T) x R d . By Section EJ the processes 

y s = vfaX**), sG[0,T], 

Z s = Dv(s,Xl> x ), sG[0,T], 

T s = Z) 2 W ( S ,X^), a €[0,7], 

A s = CDv{s,Xl> x ), s€[0,T], 

solve the 2BSDE corresponding to (X f ' x , f,g). By dO£|) and Z is in ^ (see fO) 

and (|4.2|l ). Hence, if the assumptions of Theorem 14.91 are fulfilled, (Y, Z, T, A) is the only 
solution of the 2BSDE corresponding to {X t)X , /, 5) with Z G .A*' 1 . 

Proof of Theorem 14.91 

1. Let (X ^ , Y ^ , T ' 1 ' , A ' xo ) be a solution to the 2BSDE corresponding to (X°< x °,f, g) 
with Z°' x ° G AY for some m > 0. Then, it follows from Lemma 14. II that 

Y o,x > ym^ x o,x j for all s G ^ T j ^ ( 4 30 ) 

and by symmetry, 

Y°' x ° < C/ m (s, X° s ' x °) for all s G [0, T] . (4.31) 

Recall that the inequalities (|4,3U|) and Q4.31J1 are understood in the P-almost sure sense. 
But since, by assumption, a takes values in M.i m , Xs' x ° has full support for all s G (0, T] 
(see, for instance, Nualart, 1995), and we get from (|4.3U|) and Q4.31JI that 

V m (s, x) < U m (s, x) for all (s, x) in a dense subset of [0, T]xl d . 

It follows that 

V™<U* m on[0,T]xR rf . 

Together with Proposition 14.51 this shows that VJ 71 and are finite on [0, T] x R d . By 
Remark 14.61 V™ is a viscosity supersolution and a viscosity subsolution of the PDE 
(|2~H)) on [0,7) x R d . Therefore, it follows from Proposition 03] and (A5) that 

V™ > U; n on [0, T] x R d . 

Hence, the function v = V™ = V m = U m = is continuous on [0, T] x R d and a viscosity 
solution with growth p of the PDE (|2.8|) - (|2.9j) . By (A5), v is the only viscosity solution of 
the PDE (|2~8|) - (|2~9|) with growth p. This shows 1. 
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2. Since v = V m = U m , it follows from and (IQT1) that 

Y s °' x ° = v(s, X° s ' x °) for all s G [0, T] . 

By conditioning (Y 0,x ° , Z ' 1 ' , T ' x ° , A ' 1 ' ) as in the proof of Lemma 14.11 and a continu- 
ity argument, it can be deduced that for all (t, x) G [0, T) x M. d , there exists a solution 
(Y t ' x ,Z t * l ,r t ' SB ,A t > ai ) of the 2BSDE corresponding to (X^J^g) such that G A t>x and 

= S G[t,T]. 

If for fixed (t, x) G [0, T) x (Y, Z, F, A) is a solution of the 2BSDE corresponding to 
(X t,x , f,g) such that Z G A t,x , then it follows as in 1. that 

Y s = v(s,X t s < x ) = Y s t ' x , se[t,T], 

and therefore also, 

(Z,T,A) = (Z t ' x ,T t ' x ,A^ x ) 
because Z t,x is uniquely determined by 

yt,X = yt,X + T f ^ X t,X t ^yt,X^ Z^^X^ + /"'(^X)' rf^*,* , S G [t, T] , 

and T t,x and ^4* ,:r are uniquely determined by 

z t,x = z t,x + J* A t,x dr + J° r t,x dx t,x ^ g G [t, T] . 

This completes the proof of 2. □ 



5 Monte Carlo methods for the solution of parabolic PDEs 

In this section, we provide a formal discussion of the numerical implications of our repre- 
sentation results. We start by recalling some well-known facts in the linear case. We then 
review some recent advances in the semi- and quasi- linear cases, and conclude with the 
fully non- linear case related to Theorem 14.91 

5.1 The linear case 

In this subsection, we assume that the function / is of the form 

f(t, x, y, z, 7) = -a(t, x) - P(t, x)y - n(x)'z - ^Tr [a(x)a(x)'j] 

Then, Q2.8JI is a linear parabolic PDE. Under standard conditions, it has a smooth solution 
v, and the Feynman-Kac representation theorem states that for all (t, x) G [0, T] x M. d , 



v(t,x) = E 



J B t>s a (s, Xl' x ) ds + B t>T g [x^ x 
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where 

B t , s :=ex p(/ P(r,XF)dr\ 

(see, for instance, Theorem 5.7.6 in Karatzas and Shreve, 1991). This representation sug- 
gests a numerical approximation of the function v by means of the so-called Monte Carlo 
method: 

(i) Given J independent copies {X 7 , 1 < j < j} of the process X t,x , set 

v « (t,x) := - Y, [ T B{ s a(s,Xi)ds + B\ T g (x> T ) , 

3=1 * 

where b{ s := exp ^ J*f3 ^r, xf\ dr^j. Then, it follows from the law of large numbers and 
the central limit theorem that 

v 1 - >(t, x) — > v(t, x) a.s and VJ(v (J) (t, x) — v(t, x)^ — * N (0, p) in distribution , 

where p is the variance of the random variable f. Bt^ s a (s,X*' x ) ds + B t T g (Xj, x ^J . Hence, 

v( J \t,x) is a consistent approximation of v(t,x). Moreover, in contrast to finite differences 
or finite elements methods, the error estimate is of order J -1 / 2 , independently of the 
dimension d. 

(ii) In practice, it is not possible to produce independent copies {X 5 , 1 < j < J} of the 
process X l ' x , except in trivial cases. In most cases, the above Monte Carlo approximation is 
performed by replacing the process X t,x by a suitable discrete-time approximation X N with 
time step of order N^ 1 for which independent copies {X N, i , 1 < j < j} can be produced. 
The simplest discrete-time approximation is the following discrete Euler scheme: Set X^ = 
x and for 1 < n < N, 

where t n := t + n(T — t)/N. We refer to Talay (1996) for a survey of the main results in 
this area. 



5.2 The semi-linear case 

We next consider the case where / is given by 

/(£, x, y, z, 7) = tp(t, x, y, z) - p{x)'z - - Tr [a(x)a(x)'-f] . 

Then the PDE (|2.8|) is called semi- linear. We assume that the assumptions of Theorem 14.91 
are satisfied. In view of the connection between Fisk-Stratonovich and ltd integration, the 
2BSDE (pT5 |) -(|!rr j) reduces to an uncoupled FBSDE of the form 

dY s = <p(s, X l f,Y s , Z s )ds + Z' s a(Xt> x )dW s , s G [t, T) , 
Y T = g(xF) , 
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(compare to Peng, 1991, 1992b; Pardoux and Peng 1992). For iV > 1, we denote t n := 
t + n(T — t)/N, n = 0, . . . , N, and we define the discrete-time approximation Y N of Y by 
the backward scheme 

Y» := 9 (X¥) , 

and, for n = 1, . . . , N, 



Y+ 



N 



E 



Y N \X 



t.x 



yN 
1 ' ^tn-l 



{tn tn— l) 



(5.1) 



Zf := (a(Xj' x JO^E 

In— 1 J. J. V V tn — l ' ' 

f-n •'n— 1 

Then, we have 

limsup viV — f (t, x)| < cxd , 

see for instance, Zhang (2001), Bally and Pages (2002), Bouchard and Touzi (2004). The 
practical implementation of this backward scheme requires the computation of the condi- 
tional expectations appearing in (j5.1j) and (|5.2|) . This suggests the use of a Monte Carlo 
approximation, as in the linear case. But at every time step, we need to compute condi- 
tional expectations based on J independent copies {X J , 1 < j < J} of the process X t,x . 
Recently, several approaches to this problem have been developed. We refer to Lions and 
Regnier (2001), Bally and Pages (2003), Glasserman (2003), Bouchard and Touzi (2004) 
and the references therein for the methodology and the analysis of such non-linear Monte 
Carlo methods. 

5.3 The quasi-linear case 

It is shown in Antonelli (1993) and Ma et al. (1994) that coupled FBSDEs of the form 

dX s = fx(s, X s , Y s , Z s )ds + a{s, X s ,Y s )dW s , s £ [t, T] , 
X t = x 

dY s = tp(s, X S ,Y S , Z s )ds + Z' s a(s, X s ,Y s )dW s , s G [t, T) , 
Y T = g(X T ) , 

are related to quasi-linear PDEs of the form ()2.8|) - H2.9|) with 

f{t, x, y, z, 7) = (p(t, x, y, z) - fi(t, x, y, z)' z - ^ Tr [a(t, x, y)a(t, x, y)'j] , 

see also, Pardoux and Tang (1999). Delarue and Menozzi (2004) have used this relation to 
build a Monte Carlo scheme for the numerical solution of quasi-linear parabolic PDEs. 

5.4 The fully non-linear case 

We now discuss the case of a general / as in the previous section. Set 

ip(t,x,y,z,j) := f(t,x,y,z,j) +/j,(x)'z + - Tr [<j(x)ct{x)' ~{] . (5.3) 



{W tn -W tn _ 1 )Y»\X, 



(5.2) 
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Then for all (t,x) £ [0,T) x R d the 2BSDE corresponding to (X^J^) can be written as 



dY s = i P (s,X t s ' x ,Y s ,Z s ,T s )ds + Z' s a(X t s ' x )dW s , s € [t,T) , (5.4) 
dZ s = A s ds + r s dXl' x , s€[t,T), (5.5) 

(5.6) 



Yt = giX**) 



We assume that the conditions of Theorem 14.91 hold true, so that the PDE (|2.8j) has a 
unique viscosity solution v with growth p = max {p2 , P3 , P2P4 1 Pi + 2pi } , and there exists 
a unique solution {Y l ' x , Z l ' x , r*' x , A l ' x ) to the 2BSDE (|Q|) - (j51))) with Z l ' x £ „4*' x . 

Comparing with the backward scheme (|5,l|) - (|5,2j) in the semi-linear case, we suggest the 
following discrete-time approximation of the processes Y*' x , Z t,x and T t,x : 



Y T N := , Z% := Dg(X^ x ) 



and, for n = 1, . . . , iV, 



E 



t,a; T^Af /v/V T-iiV 



2 



*n-l 



1 



.TV 

tn-l 



tn tn~l 
1 



N I vt,x 



E 



't,s \— 1 



A precise analysis of the latter backward scheme is left for future research. We conjecture 
that 



if v is C 2 , then 
and if v is C 3 , then 



-> Du(t, x) as iV -> 00 



A' 



t;(t, x) as N — > 00 , 



rf -» 7J> 2 t>(£, x) as iV 00 . 



5.5 Connections with standard stochastic control 

Let Uq be the collection of all progressively measurable processes (^t)te\o,T] with values in 
a given bounded subset U cR k . Let b : [0, T] x R d x 17 M d and a : [0, T] x M. d x 17 S d 
be continuous functions, Lipschitz in x uniformly in (i, u). We call a process 1^ 6 Wo an 
admissible control if 



E 



(\b(s,x,u s )\ + \a(s,x,u s )\ 2 )ds 



< 00 



for all x £ M rf and denote the class of all admissible controls by Li. For every pair of initial 
conditions (t, x) £ [0, T] x M rf and each admissible control process v £ U, the SDE 



dJf s = b(s, X s , v s )ds + a(s, X s , u s )dW s , s £ [t,T], 
X t = x , 



(5.7) 
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has a unique strong solution, which we denote by (X s ' x ' v ) s ^[t l T]- Let a,f3 : [0, T] x W 1 x U — > 
M and 5 : -> 1 be continuous functions with /3 < 0, and assume that a and g have 
quadratic growth in x uniformly in (t,u). Consider the stochastic control problem 

v(t, x) : = supE 



where 



J Bl s a(^X t s ' x '\u s )ds + Bl T g(X t /' 1 
B v t s := exp (J 0(r, X^, v r )dr^j , < t < s < T 



By the classical method of dynamic programming, the function v can be shown to solve 
the Hamilton-Jacobi-Bellman equation 

— vt(t, x) + f(t, x, v(t, x), Dv(t, x), D 2 v(t, x)) = 



(5i 

v{T,x) = g[x) , 



where 



f(t, x, y, z, 7) := sup 1 a(t, x, u) + (3(t, x, u)y + b(t, x, u)' z Ti[aa'(t, x, u) 7] 1 . 

ueu [ 2 J 

This is a fully non-linear parabolic PDE covered by the class (|2.8)) - (|2.9ft . Note that / is 
convex in the triple (y, z,j). The semi-linear case is obtained when there is no control on 
the diffusion part, that is, a(i, x, u) = a(t, x) is independent of u. 

If the value function v has a stochastic representation in terms of a 2BSDE satisfying the 
assumptions of Theorem (j4.9|) . then the Monte Carlo scheme of the previous subsection can 
be applied to approximate v. 

Under suitable regularity assumptions, the optimal control at time t is known to be of 
the form 

u(t, x, v(t, x), Dv(t, x),D 2 v(t, x)) , 
where u is a maximizer of the expression 

sup I a(t, x, u) + f3(t, x, u)v(t, x) + b(t, x, u)'Dv(t, x) — -Tr [aa'(t, x, u)D 2 v(t, x)j 
u&u I 2 

Notice that the numerical scheme suggested in the Subsection 15.41 calculates at each step 
in time the values of the processes (X l ' x , Y t,x , Z t,x , T t,x ). Therefore, the optimal control is 
also provided by this numerical scheme by 

~/ vt,X \^t,X ryt,X T^t,X\ 

u s = u{s,x s ' ,Y S ! ,z s ' ,ry ) . 



6 Boundary value problems 

In this section, we give a brief outline of an extension to boundary value problems. Namely, 
let O C R d be an open set. For (t,x) G [0, T) x R d , the process X l ' x is given as in (|2.;-{j) . 
but we stop it at the boundary of O. Then we extend the terminal condition ()2.7|) in the 
2BSDE to a boundary condition. In other words, we introduce the exit time 

9 := inf {s > t I Xl' x £ O) 
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and modify the 2BSDE lf23Jl - lf2~7j) to 

/■TAB t-TAO 

Y sA9 = g(X^ e ) - / f(r, X^ x ,Y r ,T r , A r )dr - Z' r o dX? , s G [t, T] , 

JsAd JsAe 
i-TAd i-TAB 

ZsAd = Z TA8 - / A r dr - / T r dX l r : x , s G [t, T] . 

JsA0 JsA9 

Then the corresponding PDE is the same as (|2.8|) - (|2.9|) . but it only holds in [0, T) x O. 
Also, the terminal condition v(T,x) = g(x) only holds in O. In addition, the following 
lateral boundary condition holds 

v (t, x) = g(x) , for all (t, x) G [0, T] x dO . 

All the results of the previous sections can easily be adapted to this case. Moreover, if we 
assume that O is bounded, most of the technicalities related to the growth of solutions are 
avoided as the solutions are expected to be bounded. 
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